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Description 



SYSTEM AND METHOD FOR OPTIMIZING 
MANUFACTURING PROCESSES USING 
REAL TIME PARTITIONED PROCESS 
CAPABILITY ANALYSIS 

Background of Invention 
[0001] 1. Technical Field 

[0002] The present invention relates generally to manufacturing 
processes, and more specifically relates to a system and 
method for optimizing a manufacturing process using 
partitioned process capability analysis. 

[0003] 2. Related Art 

[0004] | n complex manufacturing environments, such as semi- 
conductor processing, it is often difficult to quantify the 
true capability of manufacturing processes or tools on a 
real time basis. Thus, it is often difficult to prospectively 
evaluate the efficacy of using a process or tool in a given 
way. For instance, in a semiconductor fabrication process, 



it is often desirable to take sample measurements (i.e., 
metrology sampling) from a "lot" of wafers when measur- 
ing overlay and the like to ensure high performance. A 
typical lot comprises about 20 silicon wafers. However, 
metrology adds a significant cost to the overall process. 
Accordingly, to the extent "skip lot sampling" can be im- 
plemented to eliminate metrology sampling, the cost of 
the overall fabrication process can be lowered. Other as- 
pects of wafer processing include the requirement to se- 
lect a tool to deploy product for the particular operation. 
Determining which tool will provide the best balance of 
performance and cost effectiveness is critical in achieving 
overall manufacturing efficiencies. 
[0005] Existing techniques for analyzing capability generally in- 
volve reviewing data collected from previous manufactur- 
ing operations. Statistical Process Control (SPC) is often 
used as the mechanism for monitoring changes in capa- 
bility. However, techniques such as SPC generate pro- 
hibitively large amounts of data. The volume of data re- 
sults in slow reactions to change, and is difficult to use for 
troubleshooting. Often, the SPC charts do not provide a 
detailed understanding of the interactions inherent in the 
process controls. 



[0006] For instance, skip lot sampling plans, which dictate when 
the metrology step can be skipped for a specific lot, are 
often determined based on process capability analysis 
(Cpk) calculations of very broadly generalized datasets 
such as technology and level combinations. Unfortunately, 
such calculations are typically made on an infrequent ba- 
sis and are typically not revisited for significant periods of 
time. Thus, the capability analysis reacts very slowly, or 
not at all, to performance improvements or degradations. 
Capability analysis systems are, for example, described in 
US Patent Application US 2002/0026257 Al, published on 
February 28, 2002 by Newmark, entitled "Capability Anal- 
ysis of Assembly Line Production, "which is hereby incor- 
porated by reference. 

[0007] Moreover, due to the need to simplify SPC charting, data 
related to many technologies and levels are often com- 
bined in the same analysis. Capability analysis of the 
combined data hides the individual capabilities of specific 
tools, reticles, part numbers, etc., and results in missed 
optimizations. For instance, a targeted subset of the data 
may indicate a low risk opportunity to skip metrology for 
a lot of wafers under a given set of circumstances, which 
may be missed since the data could only be analyzed at a 



very high level. Similar misleading results could also im- 
pact tool deployment, which is historically based on a tool 
capability analysis 
Summary of Invention 

[0008] The present invention addresses the above-mentioned 
problems, as well as others, by providing a system and 
method for optimizing a manufacturing process. In a first 
aspect, the invention provides a method of processing a 
workpiece, comprising: providing a database that can be 
filtered into subgroups of operational data gathered from 
previously processed workpieces; calculating evaluation 
criteria for a selected subgroup of operational data; deter- 
mining whether the evaluation criteria satisfy predeter- 
mined requirements; if the evaluation criteria satisfy the 
predetermined requirements, processing the workpiece 
using a process condition determined by the selected 
subgroup of operational data; and if the evaluation criteria 
do not satisfy the predetermined requirements, repeating 
the method with a different selected subgroup of opera- 
tional data. 

[0009] | n a second aspect, the invention provides a system for 
optimizing a manufacturing process, comprising: a 
database of operational data gathered from previously 



performed manufacturing processes; a filtering system for 
filtering the database into a data subset; a calculation 
system for calculating evaluation criteria for the data sub- 
set; an iteration system that causes the filtering and cal- 
culation systems to be rerun for a different data subset; 
and a system for determining operating conditions of the 
manufacturing process based on the calculated evaluation 
criteria. 

[0010] | n a third aspect, the invention provides a program prod- 
uct stored on a recordable medium for optimizing a man- 
ufacturing process, comprising: means for filtering a 
database of operational data gathered from previously 
performed manufacturing processes into a plurality of 
data subsets; means for calculating evaluation criteria for 
a selected data subset; means for determining if the eval- 
uation criteria meet a set of predetermined requirements; 
and means for repeating the calculating and determining 
processes for a new data subset if the selected data sub- 
set fails to provide evaluation criteria that meet the set of 
predetermined requirements. 

[001 1] | n a fourth aspect, the invention provides a method of op- 
timizing a manufacturing process, comprising: providing a 
database of operational data gathered from previously 



performed semiconductor fabrication processes; providing 
a set of filters that include operational parameters of the 
current metrology process; filtering the database with a 
selected filter to generate a data subset; calculating eval- 
uation criteria for a selected data subset; iterating the fil- 
tering and calculating steps for different data subsets; and 
determining operating conditions of the manufacturing 
process based on the calculated evaluation criteria. 
Brief Description of Drawings 

[0012] These and other features of this invention will be more 

readily understood from the following detailed description 
of the various aspects of the invention taken in conjunc- 
tion with the accompanying drawings in which: 

[0013] Figure 1 depicts a process optimization system in accor- 
dance with the present invention. 

[0014] Figure 2 depicts a flow diagram of an optimization pro- 
cess involving skip lot sampling. 

[0015] Figure 3 depicts four data subsets generated using four 

different filters for the skip lot sampling process of Figure 
2. 

[0016] Figure 4 depicts a flow diagram of a capability-based tool 
deployment system in accordance with the present inven- 
tion. 



Detailed Description 



[0017] Referring now to the drawings, Figure 1 depicts a process 
optimization system 10 that receives as input a set of 
process parameters 30 and outputs process settings 26 in 
real time for use in a process 28. In two of the exemplary 
embodiments described herein, process 28 involves a 
semiconductor processing operation involving: (1) skip lot 
sample planning, i.e., determining whether a lot of wafers 
should be subjected to a costly metrology process; and (2) 
tool deployment, i.e., determining which tool should be 
deployed for a particular process step. However, it should 
be understood that the present invention could be applied 
to any manufacturing process in which a processing deci- 
sion must be made, including, e.g., defect inspections, 
electrical testing, etc. 

[0018] Process parameters 30 may comprise any parameters or 
operational conditions that describe the nature of the 
manufacturing process to be performed. For instance, pa- 
rameters 30 may include: a semiconductor technology, an 
operation to be performed, the tool to be used, tool set- 
tings, lot size, part numbers, etc. Process settings 26 may 
include any setting or operational condition that process 
28 can use to optimize operations of process 28. For ex- 



ample, process settings 26 may include a finding that skip 
lot processing should be implemented, or that it makes 
sense to use a low efficiency tool. 
[0019] process optimization system 10 operates by analyzing 

historical data 16, which comprises a database of opera- 
tional data from prior processing operations, to determine 
if an optimization is warranted for a given set of input pa- 
rameters 30. Historical data 16 may include any type of 
relevant operational data that describes both the nature of 
the operation and the results. For example, historical data 
may include performance data for given operations using 
different operational parameters and conditions. The data 
may be stored in any manner, e.g., in one or more 
databases, distributed over a network, in a flat file, in RAM 
or ROM, etc. 

[0020] process optimization system 10 includes a data filtering 
system 12 that utilizes a set of filters 15 to identify sub- 
sets of data from historical data 16 that match one or 
more inputted process parameters 30. For instance, if the 
inputted process parameters 30 indicated that process 28 
involved technology A, part number B, using tool C, then 
data filtering system 12 would search historical data 16 to 
identify data from past operations with the same (or simi- 



lar) process parameters. For instance, possible data sub- 
sets could be generated by filtering on A, AB, ABC, AC, BC 
or just C. 

[0021] Filter selection system 14 also provides a mechanism for 
managing and selecting the filters 15. The set of available 
filters 15 may be predetermined, or could be dynamically 
generated based on the input process parameters 30. 
Note that there are no limitations on the number or types 
of the filters 15, e.g., they could be hierarchical or non- 
hierarchical. Filter selection system 14 selects and imple- 
ments filters 15 one at a time to generate unique subsets 
of data. Any mechanism can be used to implement the fil- 
ters, e.g., a relational database, etc. Each time a new data 
subset 18 is generated, it is evaluated using the process 
described below. The filter selection process can be im- 
plemented in any manner, e.g., from broad to narrow, 
narrow to broad, etc. 

[0022] After an initial filter is selected, a data subset 18 will be 

generated, which includes operational data for all previous 
processes stored in historical data 16 that met the filter- 
ing criteria. In general, the broader the filter, the more re- 
sults in the data subset 18. After the data subset 18 is 
generated, it is passed to a calculation system 20 that cal- 



culates one or more evaluation criteria 21 that measure 
the efficacy of a proposed optimization under the given 
conditions (e.g., should skip lot sampling be implemented 
for technology A using tool B). Illustrative evaluation crite- 
ria include a process capability ratio (Cpk), a normality 
curve or hypothesis, and a value N indicating a sample 
size. Obviously, the specific types of evaluation criteria 
used may vary and can depend on the particular process 
28 being optimized. 
[0023] | n one possible embodiment, once the various evaluation 
criteria 21 are calculated, they may be passed to require- 
ment analysis system 22 to determine if criteria 21 meet a 
minimum threshold. Specifically, each criterion is com- 
pared or evaluated against a predetermined requirement 
to determine if the calculated evaluation criteria 21 are 
acceptable. For instance, if the process capability ratio 
Cpk meets a predetermined threshold "and"the normality 
curve meets a hypothetical requirement "and"N is greater 
than a minimum sample size, then the evaluation criteria 
21 would be deemed acceptable by requirement analysis 
system 22. 

[0024] if the evaluation criteria 21 are acceptable, then the opti- 
mization can be implemented using conditions or settings 



determined from the selected filter and/or data subset 18. 
Alternatively, iteration system 23 may be implemented to 
repeat the filtering 12/calculation 20/requirement analy- 
sis 22 processes to evaluate other possible filter selec- 
tions and data subsets 18. In this case, multiple different 
possible optimization configurations that meet the neces- 
sary requirements could be collected and passed on to a 
process settings system 24 or process 28 for further eval- 
uation. When an acceptable evaluation criteria 21 is deter- 
mined, process settings system 24 is used to transform 
the related evaluation criteria, filter parameters, historical 
data, etc., into set points or other values that can be used 
by process 28. 

[0025] | n either case, if the evaluation criteria 21 was not accept- 
able, then (in a similar fashion to that just described) iter- 
ation system 23 would pass control back to filter selection 
system 14, which would determine if there are any other 
filters that have not been selected. If other filters exist, 
then: (1) data filtering system 12 selects a new filter and 
uses the new filter to generate an updated data subset 18; 
(2) calculation system 20 recalculates the evaluation crite- 
ria 21; and (3) analysis system 22 rechecks to see if the 
recalculated evaluation criteria 21 is acceptable. 



[0026] | n an embodiment wherein the first available optimization 
is sought, the filtering 12/calculation 20/requirement 
analysis 22 processes will continue to iterate until either 
all possible filters have been exhausted or until a set of 
evaluation criteria 21 is deemed acceptable by require- 
ment analysis system 22. In this embodiment, if the eval- 
uation criteria 21 for any filter selection are found to be 
acceptable, then the optimization can be implemented. If 
however, the evaluation criteria fail for each possible filter 
15, then process settings system 24 could use default, or 
un-optimized output process settings. 

[0027] | n the case where multiple possible optimizations are 

sought, the filteringl2/calculation 20/requirement analy- 
sis 22 processes will continue to iterate until all possible 
filters have been exhausted. In one variation to this em- 
bodiment, requirement analysis system 22 could be elimi- 
nated altogether, allowing all possible optimization con- 
figurations to be collected, regardless of whether they met 
a minimum standard. 

[0028] Referring now to Figure 2, a flow diagram of an optimiza- 
tion process involving skip lot sampling is shown. At the 
first step SI, a filter is selected, which is applied to a 
database of historical metrology data. In this case, four 



possible filters are available, (1) Technology/Level, (2) Part 
Number(PN)/Level, (3) Technology/Level/Tool, and (4) PN/ 
Level/Tool. Depending on which filter is selected, a 
unique subset of metrology data is generated. 

[0029] At step S2, a set of evaluation criteria is calculated from 

the data subset. In this case, a capability ratio, a normality 
curve, and a minimum sample size (N) is calculated. 

[0030] At step S3, a first test occurs to determine if N is greater 
than a minimum required sample size. The minimum re- 
quired sample size could be selected in any manner, e.g., 
it could be preset based on experiences of the users. If N 
is greater than the minimum sample size, a second test 
occurs at step S4, which determines whether the normality 
curve (or hypothesis) is acceptable. Deviations from a 
standard normal distribution can be readily detected in 
any manner. Depending on what criteria are used to de- 
termine the historical data set, it is possible to find bi- 
modal and non-normal distributions which give adequate 
capability ratio values, but which have significant tails, 
i.e., spikes outside the normal distribution curve. In these 
situations, if the lots in the tail of the distribution share a 
common factor (e.g., broken tool, degraded process, etc.), 
a small sample of the lots available for skipping could ex- 



perience the vast majority of the risk. If all lots in the 
sample set used the sample skip rules, the subset in the 
tail runs a significant chance of being shipped "out of 
spec" without being measured. 
[0031] |f the normality hypothesis is met, then a third test occurs 
at step S5, which determines whether the capability ratio 
is greater than a minimum required value. The capability 
ratio may comprise any type of capability analysis, as is 
known in the art. Possible capability ratios may for in- 
stance include, a classical process capability ratio Cpk, a 
sampling capability ratio, etc. In one exemplary embodi- 
ment, the capability ratio comprises a confidence interval 
(C ) calculated as follows: 
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where Z is a score, and a sampling capability ratio C sk is given by: 
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and USL is an upper specification limit and where S is a sample standard deviation given 



by: 




and where the sample mean is determined by averaging data points X t as follows: 



If the capability ratio is greater than the minimum required, then skip lot sampling is 



performed at step S6. 



[0032] |f any one 0 f the tests fails at steps S3-S5, then the pro- 
cess is passed to step S8, which determines whether all of 
the filters have been exhausted. If all of the filters have 
not been exhausted, then control is passed back to step 
SI. At this point, a new filter is selected, and steps S2-S5 
are repeated to determine if the recalculated evaluation 
criteria for the new filter is acceptable. The process is re- 
peated until either: (1) acceptable evaluation criteria are 
obtained; or (2) all the filters are exhausted at step S8 
(i.e., none of the filters yield acceptable evaluation crite- 
ria). If all the filters are exhausted, then metrology is per- 
formed at step S7. 

[0033] Figure 3 depicts the calculated evaluation criteria for the 
four illustrative filters described in Figure 2. Namely, the 
upper left hand quadrant depicts evaluation criteria for 
Technology/Level, the upper right hand quadrant depicts 
evaluation criteria for Part Number(WPN)/ Level, the lower 
left hand quadrant depicts evaluation criteria for Technol- 
ogy/Level/Tool, and the lower right hand quadrant de- 
picts evaluation criteria for WPN/Level/Tool. In this exam- 
ple, "csk,l" represents a capability ratio, "Normal" repre- 
sents the normality hypothesis which is shown as a bar 
graph in each quadrant, and "n" represents the number of 



records or sample located for the particular filter. For this 
example, csk,l must be greater than 1.0, Normal must be 
"yes," and n must be greater than 12 for the criteria to be 
acceptable. 

[0034] The upper left hand quadrant shows first filter results for 
technology CSOI9S2 and level NR. As can be seen, n=204, 
csk,l=0.81 and Normal=no. Accordingly, for this Technol- 
ogy/Level filter selection, the calculated evaluation criteria 
would be unacceptable since csk,l was less than 1.0 and 
Normal = no. Thus, a next filter would be selected. 

[0035] The upper right hand quadrant shows second filter results 
for Part Number 0000070P8959 and level NR, which is a 
subset of the data generated in the upper left hand quad- 
rant. As can be seen, n=81, csk, 1=0. 77 and Normal=yes. 
Accordingly, for this WPN/Level filter selection, the calcu- 
lated evaluation criteria would also be unacceptable since 
csk,l was less than 1.0. Thus, a next filter would be se- 
lected. 

[0036] The lower left hand quadrant shows third filter results for 
technology CSOI9S2, level NR, and Tool X52V, which is a 
different subset of the data generated in the upper left 
hand quadrant. As can be seen, n=109, csk,l = 1.13 and 
Normal = no. Accordingly, for this Technology/Level/Tool 



filter selection, the calculated evaluation criteria would 
also be unacceptable since Normal = no. Thus, a next filter 
would be selected. 

[0037] The lower right hand quadrant shows fourth filter results 
for Part Number 0000070P8959, level NR, and tool X52V, 
which is a subset of the data generated in each of the 
other three quadrants. As can be seen, n=45, csk,l = 1.05 
and Normal=yes. Accordingly, for this WPN/Level/Tool fil- 
ter selection, the calculated evaluation criteria would be 
acceptable since csk,l was greater than 1.0, n was greater 
than 12, and Normal=yes. 

[0038] Thus, using these results, the optimization could be im- 
plemented in any desirable manner. For instance, skip lot 
sampling could be implemented using standard statistical 
techniques based on capability ratio value, e.g., 1:2, 1:4, 
1:6, 1:8, wherein higher Cpk values result in fewer mea- 
surements. 

[0039] Referring now to Figure 4, a flow diagram depicting a ca- 
pability-based tool deployment system is shown. In this 
embodiment, process optimization system 10 is utilized 
to help select the most efficient tool from a plurality of 
candidate tools to perform a particular function. In this 
embodiment, when a product 40 is available for process- 



ing, a real-time capability analysis 42 is launched to de- 
termine the best tool to process the product 40. Process 
optimization system 10 is utilized to calculate a set of 
evaluation criteria values 44 (e.g., Cpk and/or normality) 
for each candidate tool. In such an embodiment, data fil- 
tering system 12 described in Figure 1 would identify all 
candidate combinations for deployment of a lot based 
upon industry standard tool qualification requirements. 
Each evaluation criteria value is then calculated as a func- 
tion of a filtered subset of the historical data for the can- 
didate tool, as described above. For instance, hypothetical 
Tool A might have filtered subsets "Tool A/Technology A/ 
Part A" and "Tool A/Part B," which have respective Cpk 
values of 0.95 and 0.80, and hypothetical Tool B might 
have filtered subsets "Tool B/Technology A/Part C'and 
"Tool B/Part B, "which have respective Cpk values of 1.2 
and 0.60. 

[0040] Then, ranking system 52 would order the candidate tools 
by evaluation criteria values 44. Other factors used by 
ranking system 52 might include individual tool qualifica- 
tion requirements 46, current WIP (work in pro- 
cess)loading 48for all tools, tool availability 50, etc. Real- 
time capability analysis could then query 54 the ranking 



system 52 to determine the best tool to deploy, which in 
turn would deploy the best tool 56. 

[0041] Thus, as can been seen, by using this invention to parti- 
tion historical data at different granularities and/or based 
on different input parameters, relevant operational data 
can be examined in real time from different perspectives 
to optimize a manufacturing process. 

[0042] | t j S understood that the systems, functions, mechanisms, 
methods, engines and modules described herein can be 
implemented in hardware, software, or a combination of 
hardware and software. They may be implemented by any 
type of computer system or other apparatus adapted for 
carrying out the methods described herein. A typical com- 
bination of hardware and software could be a general- 
purpose computer system with a computer program that, 
when loaded and executed, controls the computer system 
such that it carries out the methods described herein. Al- 
ternatively, a specific use computer, containing special- 
ized hardware for carrying out one or more of the func- 
tional tasks of the invention could be utilized. The present 
invention can also be embedded in a computer program 
product, which comprises all the features enabling the 
implementation of the methods and functions described 



herein, and which - when loaded in a computer system - 
is able to carry out these methods and functions. Com- 
puter program, software program, program, program 
product, or software, in the present context mean any ex- 
pression, in any language, code or notation, of a set of in- 
structions intended to cause a system having an informa- 
tion processing capability to perform a particular function 
either directly or after either or both of the following: (a) 
conversion to another language, code or notation; and/or 
(b) reproduction in a different material form. 
[0043] The foregoing description of the invention has been pre- 
sented for purposes of illustration and description. It is 
not intended to be exhaustive or to limit the invention to 
the precise form disclosed, and obviously, many modifica- 
tions and variations are possible. Such modifications and 
variations that may be apparent to a person skilled in the 
art are intended to be included within the scope of this in- 
vention as defined by the accompanying claims. 



